System and method to enable correction to application of substantially colorless material over identified text via segmentation

ABSTRACT

Disclosed is a processor-implemented method for processing image data using an image processing apparatus. The processor is configured to receive a PDL file of image data and raster image process (RIP) the PDL file to determine pixels representing text. The ripped file is then segmented to determine at least any pixels representing text that were not initially indicated or identified by the ripped file. The results are combined to determine locations for marking onto a substrate by the output device using substantially colorless marking material over text pixels (to coat marked text pixels). In some instances, locations for covering text pixels with substantially colorless marking material can be tagged during segmenting image data, using a tag plane.

FIELD

This application generally relates to digital image processing, and inparticular, to a system and method for identifying pixels representingtext in printed documents to improve image quality.

BACKGROUND

Output devices, such as multi-function printers or devices (MFDs), arebecoming quite complex and deal with sophisticated concurrentoperations. During a print job or copy job, these devices may encounterproblems while processing pixels of image data, including identifyingall of the pixels representing more intricate details, such as text.This can affect image quality of the document when marking andoutputting.

Such problems can occur when processed image data is sent for output.For example, each pixel of image data representing text may not beidentified when page description language (PDL) image data is sent forrasterizing and output. The raster image may have mismatched text data(e.g., as compared to the electronic file) and can produce low densitypixels marked on a page.

Moreover, some systems are configured to applying a clear coating overidentified text pixels. However, if such pixels are not identified, andthus not coated, the printed or output document may resulting inskipped, hole ridden, rubbed off, and/or low quality text (e.g., due tofailure to mark a pixel, or failure to cover a marked pixel, which cancause wear or removal of a marking).

SUMMARY

One aspect of the disclosure provides a processor-implemented method forprocessing image data using an image processing apparatus. The imageprocessing apparatus has at least one processor for processing documentscontaining image data having a plurality of pixels. The method includesthe following acts implemented by the at least one processor: receivinga page description language file of image data comprising a plurality ofpixels and related image instructions;

raster image processing the page description language file to create abitmap file with a first data structure indicating at least pixelsrepresenting text;

segmenting the bitmap file to determine at least pixels in the bitmapfile representing text not indicated in the first data structure to forma second data structure, and

combining the first data structure and the second data structure to forma third data structure indicating locations for marking substantiallycolorless marking material onto a substrate using an image outputdevice.

Another aspect of the disclosure provides a system for processing imagedata having a plurality of pixels. The system has at least oneprocessing element with an input and an output and is configured toreceive and process pixels of the image data. The at least oneprocessing element is configured to:

receive a page description language file of image data comprising aplurality of pixels and related image instructions;

raster image process the page description language file to create abitmap file with a first data structure indicating at least pixelsrepresenting text;

segment the bitmap file to determine at least pixels in the bitmap filerepresenting text not indicated in the first data structure to form asecond data structure, and

combine the first data structure and the second data structure to form athird data structure indicating locations for marking substantiallycolorless marking material onto a substrate using an image outputdevice.

Yet another aspect of the disclosure provides a non-transitory computerreadable medium having stored computer executable instructions, whereinthe computer executable instructions, when executed by a computer,direct a computer to perform a method for processing image data, themethod includes: receiving a page description language file of imagedata comprising a plurality of pixels and related image instructions;

raster image processing the page description language file to create abitmap file with a first data structure indicating at least pixelsrepresenting text;

segmenting the bitmap file to determine at least pixels in the bitmapfile representing text not indicated in the first data structure to forma second data structure, and

combining the first data structure and the second data structure to forma third data structure indicating locations for marking substantiallycolorless marking material onto a substrate using an image outputdevice.

Other features of one or more embodiments of this disclosure will seemapparent from the following detailed description, and accompanyingdrawings, and the appended claims.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the present disclosure will now be disclosed, by way ofexample only, with reference to the accompanying schematic drawings inwhich corresponding reference symbols indicate corresponding parts, inwhich:

FIG. 1 illustrates a flow chart/block diagram illustrating a method forprocessing image data in accordance with an embodiment of the presentdisclosure;

FIG. 2 illustrates a schematic representation of implementing the methodof FIG. 1, in accordance with an embodiment;

FIG. 3 illustrates a schematic representation of implementing the methodof FIG. 1, in accordance with another embodiment;

FIG. 4 illustrates an exemplary method of segmenting the rasterizedimage data as indicated in FIG. 1, in accordance with an embodiment;

FIG. 5 illustrates an exemplary block diagram of an image path of asystem, device, or image processing apparatus, in accordance with anembodiment, comprising at least one processor and an output device, forimplementing the method of FIG. 1, in accordance with an embodiment, and

FIG. 6 illustrates a block diagram of a system, device, or imageprocessing apparatus for implementing the method of FIG. 1, inaccordance with an embodiment.

DETAILED DESCRIPTION

According to one or more embodiments, a methodology is disclosed thatdetermines text pixels for marking and output using marking materials(e.g., ink, toner, or other marking medium having any type of colorant).The locations of the determined text pixels are used to determine pixelsto be marked or covered with a substantially colorless or clear markingmaterial. Because the colorless material coating can reduce or preventwear or removal of marking material for a marked pixel, identificationof text pixel locations for covering increases quality of the printedtext pixels on a substrate.

This disclosure uses algorithms, methods, and processing elements (e.g.,hardware) in multi-function systems/devices to determine text pixelstaking the above into consideration, and identifies their locations toidentify locations for marking substantially colorless marking materialthereover.

Throughout this disclosure, the term “pixel” as used herein is definedas a pictorial element of data that may be provided in any format, colorspace, or compression state which is associated with or readilyconvertible into data that can be associated with a small area or spotin an image that is printed or displayed. Generally, a pixel is definedin terms of value (or brightness or intensity) and its position in animage. A pixel may be associated with an array of other small areas orspots within an image, including a portion of an image, such as a colorseparation plane. Accordingly, the term “pixel location” is also usedinterchangeably herein with the term pixel to represent a pictorialelement of image data as defined above. An image generally comprises aplurality of pixels or pixel locations having a number of componentsthat contribute to defining the image when it is either printed ordisplayed.

As used herein, “device dependent” color space (or image data) meanscolor schemes which are tied to or related to color production by amachine, such as printer, scanner or monitor. Typical device dependentcolor spaces, for example, include red-green-blue (RGB) orcyan-magenta-yellow-black (CMYK) color spaces. The color gamut isproduced by a machine using different combination of these colors.

On the other hand, “device independent” color space (or image data), asused herein, means color schemes which are not tied to color productionof a machine. Typical device independent color spaces include, forinstance, sRGB, CIE XYZ, YCbCr, and CIE (L*, a*, b*) color spaces. Nodevice is needed to produce these colors. Rather, the color space isrelated to human observation of color.

Additionally, as used herein, an “electronic image” includes machine- orcomputer-readable data for electronically reproducing an image. Itincludes any electronic media content that is intended to be used in anelectronic form or transmitted to a marking engine to be printed. Insome instances, the electronic image may be an electronic document. Asused herein, “electronic document” means any electronic media contentthat is intended to be used in an electronic form or printed output.Pixels in an electronic document may be formatted as Red-Green-Blue(RGB), cyan-magenta-yellow-black (CMYK), a device-independent colorspace (e.g., CIE-LAB, YCrCb, XYZ, etc.), or other pixel data formats.Conversions from one color space to another may also be possible, forinstance, as known in the art. Pixels in an electronic document may beformatted, in some instances, as binary image data. Binary image data issingle bit or bi-level, with only two possible values. Moreparticularly, pixel values may be either ON (e.g., value=1) denoting anactive pixel, or OFF (e.g., value=0) denoting background and/or nopresence of marking or color.

Exemplary electronic documents may include various digital image, text,and mixed content files, such as PDF, TXT, DOC, TIFF, BMP, GIF, JPEG,and other common page description language (PDL) file and documentformats, such as Adobe® Postscript®. A page description language (PDL)is a method of describing printed pages in a printer independent format.A PDL establishes an interface between a print driver or client and aprint server or printer. No one standard PDL presently exists, and as aresult a number of industry standards have emerged. Accordingly, itshould be understood that reference to a PDL image file and/or documentthroughout this disclosure may include any of the above-mentionedexamples, or any other page description language not mentioned above.

With any PDL or other electronic image format/document, there willinevitably be a step of translation of the PDL or image format data intoa form usable by at least an image output terminal (IOT) or an outputdevice, such as a printer, a copier, or an MFD. In accordance with anembodiment, such a step may be implemented through raster imageprocessing (RIP), also known as ripping. Generally, when a document isto be printed, image data representing a document is input into a deviceand processed in an image path. For example, image data comprising aplurality of pixels is received and processed along an image path of aprocessor or system. In some instances, if the image data is not alreadyin independent color space then a step of converting the image data to adevice independent color space may be optionally performed. As the imagedata is processed, a determination may be made to determine if the inputimage data comprises different types of pixels, including text. Duringconversion of a PDL file, however, image quality problems can occur iftext is not recognized (e.g., during ripping). In such cases, textpixels can be sent within the raster image, but can sometimes gounrecognized. If text pixels are not covered with a substantiallycolorless marking material (e.g., due to not being recognized as textpixels during processing), such pixels are prone to illegibility on anoutput document due to rubbing or rubbing off of color (or black)marking material that is applied to a page or sheet, e.g., duringfinishing and/or movement of a page or sheet through the machine.Accordingly, this disclosure describes a method for processing imagedata in order to more accurately identify pixels representing text (inan output document) so that image quality of the output document isimproved.

In the detailed description below, reference is made to a determinationof pixels representing text in an electronic image while processingimage data for an output document. The determination of the text pixelsis used to identify locations for applying or marking substantiallycolorless marking material over a pixel mark (i.e., the identificationof the pixels themselves as being text pixels determines that the pixelshould be covered with the colorless marking material). Thedetermination/indication of text pixels as disclosed herein may be usedfor marking on a substrate as well, in order to identify all text pixelswithin the image data and to increase output image quality.

FIG. 1 is a flow chart/block diagram illustrating a method 100 forprocessing image data in accordance with an embodiment of thisdisclosure. The method 100 may be implemented by one or more processorsor systems, such as those illustrated in FIGS. 5 and 6 and furtherdescribed below. It should be understood by one of skill in the art thatimage data of a page or document can be processed (along image path 500in system 600, shown in FIGS. 5 and 6, for example) before execution ofthe method 100, although such processes are not discussed in detailherein. Method 100 comprises receiving a PDL file of image datacomprising a plurality of pixels of image data and related imageinstructions at 102. Such related image instructions include methods anddetails for outputting (e.g., printing) the image data, such asformatting, for example, and are not meant to be limiting. At 104, thePDF file is processed using raster image processing (ripping) to createa bitmap file (which may comprise contone image data, for example). Thebitmap file has a first data structure associated therewith indicatingat least pixels representing text. At 106, the ripped bitmap file issegmented to determine at least pixels in the bitmap file representingtext that were not indicated, identified, or determined in the firstdata structure. Segmenting the ripped bitmap file is used to determineor form a second data structure. Then, as shown at 108, the first datastructure and the second data structure are combined to form a thirddata structure indicating locations for marking substantially colorlessmarking material onto a substrate (using an image output device).

Optionally, at 110, the bitmap file (which includes information from theripped image data) and the third data structure are sent to an imageoutput device or image output terminal (IOT) for processing and output.At 112, during optional use of the IOT or the output device, text pixelsare marked on the substrate. In an embodiment, the text pixels may bemarked using information indicated by the third data structure. Forexample, in one embodiment the third data structure indicates adetermination of at least a combination of pixels that represent text(indicated or identified from both the ripped bitmap file and thesegmentation process, per the first and second data structures). Thus,the information in the third data structure can be used (e.g., by aprocessor or output device) to correctly mark text pixels onto thesubstrate (e.g., using device parameters, at a predetermined density,etc.).

Additionally, as shown at 114, the method 100 may further comprise anoptional step of marking locations (using an output device/IOT) withsubstantially colorless marking material on the substrate using on thethird data structure. That is, in an embodiment wherein the locationsindicated in the third data structure correspond to text pixels, thethird data structure may also indicate locations to mark substantiallycolorless marking material onto the substrate (e.g., over the textpixels), i.e., the third data structure can be used to determine suchlocations. In another embodiment, the third data structure directlyindicates the locations to mark substantially colorless marking materialonto the substrate. Thus, in accordance with either embodiment, afterpixels are marked on the substrate with their marking material of anycolorant(s), the pixel locations indicated in the third data structurecan be covered, coated, or marked (over) with a substantially colorlessmarking material at 114.

The “data structures” may be any type of electronic data associated withan electronic image data file that indicates elements and features ofthe image. The data structures may be configured to indicate feature(s)related to or associated with an image and/or its pixel locationsthrough an identification or recognition process or algorithm. Anynumber or type of notation may be used, and the indication process isnot limiting. For example, the data structures may be planes comprisinginformation related to pixels. The planes may indicate a type of data apixel location represents (e.g., type of pixel for output (text,background, contone)) using a binary format, e.g., YES or NO. Each planemay indicate ON and OFF pixel locations (e.g., in a binary format, e.g.,one (1) being “ON and zero (0) being “OFF”) based on what thatparticular plane represents.

In accordance with an embodiment, data structures may be binary tagplanes. That is, tags may be used to indicate that a pixel locationrepresents (or does not represent) text when output. In an embodiment,tags are placed on pixel locations that represent text. In anotherembodiment, a plurality of types of tags are placed on each pixellocation, with each tag indicating or identifying the type of data(e.g., text, background, text on tint) represented by the pixellocation. In another embodiment, tags may be used to represent textpixels of a predetermined colorant. The type, number, and use of tags,however, is not meant to be limiting.

FIG. 2 illustrates an exemplary schematic representation of a method 200for implementing the method 100 of FIG. 1 using tag planes. As shown,PDL image data comprising a plurality of pixels and related imageinstructions is received/input at 202 and raster image processed, i.e.,ripped, at 204. As a result, a bitmap file with a first data structureindicating at least pixels representing text associated therewith isprovided. A first data structure may be a font tag plane generated at208 as a result of the ripping at 204. For example, the font tag planeat 208 may be generated from the related image instructions receivedwith PDL image data. The font tag plane is a binary tag plane indicatingpixels as ON (e.g., one) or OFF (e.g., zero). In an embodiment, the fonttag plane indicates pixels locations representing text as ON. The fonttag plane may also include data or information for all colors/planes ofpixels, e.g., C, M, Y, and/or K that represent text, for example.

The bitmap file generally indicates at least color planes for whichpixel locations are associated therewith are also generated, as shown at206. In order to more accurately identify at least the pixelsrepresenting text in the document image data, the bitmap file of colorplanes (e.g., the CMYK planes) is processed using a segmentation methodat 210. Segmenting the bitmap file at 210 determines color planes forwhich pixel locations are associated therewith, as shown at 216, as wellas at least those pixels in the bitmap file representing text notindicated in the first data structure. As a result, a second datastructure in the form of a text tag plane is formed at 212. The text tagplane may, however, determine similar pixel locations determined in thefirst data structure, i.e., the font tag plane determined at 208. Inaccordance with an embodiment, the text tag plane indicates all pixellocations that represent text. The text tag plane is a binary tag planeindicating pixels as ON (e.g., one) or OFF (e.g., zero). In anembodiment, the text tag plane indicates pixels locations representingtext as ON.

The results from the font tag plane and text tag plane are then combinedat 214. An “OR” process for the two tag planes is implemented at 214 todetermine the pixel locations indicating text. So, for example, if oneplane indicates that a location is text, then the OR process indicatesthe location as text in the combined data structure or plane. Thecombination of results resulting from the “OR” process increases theaccuracy of the determination of (at least) text pixels in the documentby combining the determinations of the two planes at 208 and 212.Accordingly, in an embodiment, as a result of the combination a thirddata structure in the form of a comprehensive tag plane is formed at218. The comprehensive tag plane is a binary tag plane indicating pixelsas ON (e.g., one) or OFF (e.g., zero). In an embodiment, the text tagplane indicates pixels locations representing text as ON (e.g., a valueof one (1) indicates the presence of a text pixel and zero (0)corresponds to no font detected for the pixel).

In an embodiment, the comprehensive tag plane may be the font tag planeof 208 that is altered and updated to include the results of the texttag plane. For example, for pixel locations where segmentation at 210determines that text is resident, tags will be added (if not alreadypresent due font tagging described above) to the comprehensive tagplane.

Thereafter, the segmented color planes at 216 and the comprehensive tagplane at 218 may be sent for output (e.g., to an output device/IOT) foroutput processing. In accordance with an embodiment, the tags of thecomprehensive tag plane indicate to the output device all pixellocations representing text in the image data. Thus, the comprehensivetag plane also indicates locations for marking substantially colorlessmarking material on the substrate, since the herein disclosed method isconfigured to use a marking device/output device to mark substantiallycolorless marking material over the text pixels. As shown at 220 in FIG.2, the output device/IOT may be configured to determine locations oftext pixels based on the comprehensive tag plane. Based on thatdetermination, the output device/IOT determines locations for markingsubstantially colorless marking material onto the substrate (e.g., overthe text pixels), using a marking device, after the marking of pixels onthe substrate.

The determination of locations for marking substantially colorlessmarking material and the utilization of data by the output device/IOTmay be implemented in any number of ways, however. As noted with respectto FIG. 2, the text pixels can be determined upstream of the IOT, andthe IOT can be used to determine the locations. In another embodiment,the locations may be determined upstream (e.g., by a processor or DFE)before being sent to the IOT. FIG. 3 illustrates an alternate method 300for implementing the method 100 of FIG. 1 using tag planes. Inaccordance with an embodiment, the method 300 is implemented in a systemthat is capable of combining a RIPped determination for the applicationof substantially colorless marking material on the output document witha determination for application of the substantially colorless markingmaterial over text pixels determined through segmentation. The RIPpeddetermination may include a determination of pixels representing text,for example, and/or other pixels that may benefit from application ofsubstantially colorless marking material after marking on a document.Accordingly, the system can implement the method to ensure that at leasttext pixels are recognized and configured for marking with colorlessmarking material when output. The disclosed method can assist inimproving and/or correcting application of substantially colorlessmarking material in existing systems capable of analyzing data andapplying marks or a coating to one or more selective parts of the image.

As shown, PDL image data comprising a plurality of pixels and relatedimage instructions is received/input at 302 and raster image processed,i.e., ripped, at 304. As a result, a bitmap file with a first datastructure indicating at least pixels representing text associatedtherewith is provided. A first data structure may be a font tag planegenerated at 308 as a result of the ripping at 304. As noted above, thefont tag plane at 308 may be generated from the related imageinstructions received with PDL image data and is a binary tag planeindicating pixels as ON (e.g., one) or OFF (e.g., zero). In anembodiment, the font tag plane indicates pixels locations representingtext as ON. The font tag plane may also include data or information forall colors/planes of pixels, e.g., C, M, Y, and/or K that representtext, for example.

The bitmap file generally indicates at least color planes for whichpixel locations are associated therewith are also generated, as shown at306. The bitmap file may also include information related to pixels formarking with substantially colorless marking material. For example, theinformation may be in the form of a clear plane that indicates if thereshould be application of substantially colorless marking material topixels (such as text pixels). The application of the substantiallycolorless material may have a tonal value, much like the application ofmarking material or colorant. For example, a pixel can have an 8-bitvalue comprising 256 tones or shades in the image. In a similar manner,the clear plane can indicate a location associated with a pixel that isdetermined to be covered with substantially clear marking materialcomprising one of 256 values (i.e., 0 to 255). The RIPped clear planecan indicate a selected value. However, as previously noted, thisinitial RIPping and determination may miss or pass pixels that representtext and/or should be covered in substantially colorless markingmaterial. In order to more accurately identify at least the pixelsrepresenting text in the document image data, the bitmap file of planes(e.g., the CMYK planes) is processed using a segmentation method at 310.Segmenting the bitmap file at 310 determines and/or forwards the colorplanes for which pixel locations are associated therewith and a clearplane, as shown at 316, as well as at least those pixels in the bitmapfile representing text not indicated in the first data structure. As aresult, a second data structure in the form of a text tag plane isformed at 312. The text tag plane may, however, determine similar pixellocations determined in the first data structure, i.e., the font tagplane determined at 308. In accordance with an embodiment, the text tagplane indicates all pixel locations that represent text. The text tagplane is a binary tag plane indicating pixels as ON (e.g., one) or OFF(e.g., zero). In an embodiment, the text tag plane indicates pixelslocations representing text as ON.

The results from the font tag plane and text tag plane are then combinedat 314. An “OR” process for the two tag planes is implemented at 314 todetermine the pixel locations indicating text. So, for example, if oneplane indicates that a location is text, then the OR process indicatesthe location as text in the combined data structure or plane. Thecombination of results resulting from the “OR” process increases theaccuracy of the determination of (at least) text pixels in the documentby combining the determinations of the two planes at 308 and 312.Accordingly, in an embodiment, as a result of the combination a thirddata structure in the form of a comprehensive clear plane is formed at318. The comprehensive clear plane is a binary tag plane indicatinglocations for marking substantially colorless marking material on thesubstrate. The locations for marking such material can be determined(e.g., by a processor or engine) using at least the combined text pixellocation results of the font tag plane and text tag plane. Thecomprehensive clear plane can indicate a location as either ON (e.g.,one) or OFF (e.g., zero). In an embodiment, the comprehensive clearplane indicates locations for marking substantially colorless markingmaterial as ON (e.g., a value of one (1) indicates a correspondinglocation of a text pixel and zero (0) corresponds to a location of apixel that does not represent text).

As previously mentioned, in an embodiment, the clear plane can include avalue or level including and/or between 0 to 255, indicating an amountof substantially colorless marking material to be applied to a locationof a pixel. For example, a zero value (0) would indicate that nosubstantially clear marking material is applied to the location (e.g.,on the paper or document), and a value of 255 would indicate that thelocation is substantially fully covered with substantially clear markingmaterial. Accordingly, in order to combine the binary results of thecomprehensive clear plane at 318 with those determined during RIPping(e.g., noted at 306 and passed to 316), the binary results need to beconverted. At 320, a clear plane is converted from binary such that itsinformation can be combined with the contone content determined duringRIPping. In the binary comprehensive clear plane, if a location of pixelhas a value of zero (0), the location is given a value of zero (0) inthe contone clear plane at 320 and it is indicated as OFF (i.e., thelocation does not correspond to a text pixel). If a location of a pixelin the binary comprehensive clear plane has a value of one (1), then itis given a value of 255 in the contone clear plane at 320 and it isindicated as ON (i.e., the location corresponds to a text pixel andshould be substantially fully covered with substantially colorlessmarking material).

Thereafter, the segmented color planes and clear plane at 316 (i.e., thebitmap file) and the resulting contone clear plane at 320 are furthercombined at 322 to determine a fourth data structure indicatinglocations for marking substantially colorless marking material onto asubstrate using an image output device. The fourth data structure is aresultant clear plane determined from the combination of the clear planedata found during RIPping and the combined clear plane data resultingfrom segmentation. At 322, an “OR” process for the two planes isimplemented to determine the resultant clear plane at 324 (indicatingpixel locations of text to be marked) which can be sent from theprocessor(s) (DFE) to the output device (IOT) with the color (e.g.,CMYK) planes indicating marking of other color(s) for the image pixels.In an embodiment, the value that is higher in either the clear planefrom 316 or the clear plane from 320 is used to indicate the value ofthe substantially colorless marking material to be applied to theassociated pixel location of the resultant clear plane at 324. So, forexample, if the clear plane from 320 indicates that a location has avalue of 255, and the clear plane at 316 indicates a locationcorresponding to that pixel location is 200, then the OR processindicates the location has a value of 255 in the resultant combined datastructure or plane at 324. Such an example, however, is not meant to belimiting. The combination of results resulting from the “OR” processincreases the accuracy of the application of substantially colorlessmarking material to (at least) text pixels in the document by combiningthe determinations of the two planes at 306 (or 316) and 320.

However, it should be noted that, in accordance with an embodiment, theresultant clear plane at 324 may comprise a binary tag plane eitherindicating YES or NO locations for marking substantially colorlessmarking material thereon. That is, the clear plane can indicate alocation as either ON (e.g., one) or OFF (e.g., zero), with or withoutapplication of substantially colorless marking material, without a valueof application of the marking material associated therewith.

After the color planes and resultant clear plane are determined at 324,they may be sent for output (e.g., to an output device/IOT) for outputprocessing. At 320, the output device uses the tags of the clear planeto mark (with a marking device/output device) substantially colorlessmarking material over the text pixels.

Accordingly, FIGS. 2 and 3 show that in the herein disclosed methods theoutput device/IOT may be configured to either process a receivedcomprehensive tag plane representing text pixels to determine thelocations for marking substantially colorless marking material, orprocess a clear tag plane that indicates the locations for markingsubstantially colorless marking material (e.g., the locations can bedetermined by a processor when combining the results at 314 beforesending to the output device/IOT).

The method for segmenting the ripped bitmap file at 210 and/or 310should not be limiting. Any number of known or future methods forsegmenting image data may be implemented by this method. In anembodiment, the segmentation technology implemented by the processor(s)is an auto-windowing segmentation technique, configured to use a 2 passmethodology for analyzing pixels of image data by segmentingpixels/regions into classifications such as text, continuous tone,background, different halftone frequencies and text on tintclassifications. The segmentation parameters can be tuned to the “clean”signal that the ripped image produces. As an example, one or moresimilar methods as disclosed in U.S. Pat. No. 6,347,153 B1 to Triplettet al., issued on Feb. 12, 2002, U.S. Pat. No. 6,181,829 B1 to Clark etal., issued on Jan. 30, 2001, U.S. Pat. No. 5,296,430 to Shiau et al.,and U.S. Pat. No. 7,844,118 B1 to Li et al., each of which are assignedto the same assignee (Xerox Corporation) and are incorporated byreference in their entirety herein, may be used as a segmentationtechnique that is applied to the ripped bitmap image data. Accordingly,any number of methods may be used for the determination of the text tagplane at 212 and/or 312.

In an embodiment, segmentation is applied to the raster (ripped) imagebefore (xm2) compression.

As shown in FIGS. 2 and 3, the processing of the image data (includingripping and segmentation of the ripped image data) may be performed byone or more processing elements that are part of a device or system. Inan embodiment, a print engine 201 or 301, which may include a printdriver or print controller, produces a PDL file at 202 or 302 andprocesses it as shown from 204-218 or 304-322. More specifically, theprint engine is noted as a digital front end (DFE) (i.e., processor(s)),which is typically used for processing the image data to generate animage. In an embodiment, the print engine/DFE 201/301 can implement theripping and segmentation of the image data, as well as generation of thecomprehensive tag plane for black text, and send both the processedimage data and comprehensive tag plane to the output device/IOT foroutput (e.g., printing). The processor(s) or modules included in the DFEare not limiting. Further details regarding processing of the image dataalong an image path and an exemplary system are described below withreference to FIGS. 5 and 6, respectively.

Above it is noted that the output device is configured to mark over textpixels using substantially colorless marking material (e.g., see 220 inFIG. 2). The material may be marked over the pixel after the determinedcolor(s) of the pixel are marked, for example. In another embodiment,the material may be marked after all color(s) are marked. For example,the clear tag plane may act as a template for marking the substantiallycolorless marking material over the pixels after the substrate has beenmarked with the image data.

It should also be understood that processing techniques performed by theIOT for marking and printing on a substrate that may take place forcompatibility purposes, according to IOT settings, and the like. In anembodiment, the IOT may be configured to adjust the colorant content anddensity setting (of the marking material) for pixels (e.g., text pixels,pixels representing background, text on tint, etc.) so that theresultant output on the substrate will still yield high output imagequality using the IOT, in addition to higher quality output text pixels.

With regards to a method for determining, for example, pixel locationsthat represent text pixels, and thus locations for marking substantiallycolorless material, any number of methods may be used. FIG. 4illustrates one method that may executed as a segmentation technique at106 in method 100 and configured to be implemented by a processor todetermine at least text pixels in image data for the text tag plane(e.g., at 212 or 312) (or second data structure).

At 400 the ripped bitmap file is received. Then, at 402, for each pixellocation, it is determined if a pixel in the image data is a text pixel(e.g., using a segmentation technique, as noted above). If it is not atext pixel, i.e., NO, then the pixel location is indicated or marked(e.g., via a tag) in the second data structure at 406 as OFF (e.g., zerovalue).

If, however, at 402 it is determined that the pixel is a text pixel,i.e., YES, then the pixel location is indicated or marked (e.g., via atag) in the second data structure as ON (e.g., value of one).

After the indication/marking at 404 or 406, then at 408 the next pixellocation is selected and then processed, beginning at the determinationat 402. The method continues until all pixel locations are processed.

In accordance with an embodiment, any of the noted embodiments andimplementations shown in FIGS. 1-4 may be implemented for a particularmarking color or combination of colors. For example, for a CMYK markingdevice, the processor and/or system may be configured to determine blackonly (e.g., pure black (K)) text pixels for marking and output using theabove described methods and implementations, and, for black only pixels,marking or covering said black pixels with substantially colorlessmarking material. In another embodiment, the processor and/or system maybe configured to determine text pixels using the above described methodsand implementations for those text pixels with only cyan markingmaterial, only magenta marking material, or only yellow markingmaterial. Accordingly, in either embodiment, such indications may bemade in the second data structure (e.g., tag plane) and combined withthe ripped image data (into the third data structure) for output. Inanother embodiment, the output device/IOT may be configured to determinepixel locations representing text of one or more particular colors, andmay be configured to mark such pixels on a substrate without adjustment(e.g., at a predetermined density).

In some embodiments, the above-described features of method 100(including segmenting ripped image data) may be optionally implementedor requested by a customer for a specific device or system by selection(e.g., using a user interface (UI) or manual switch). It may beimplemented locally (at the machine) or remotely (through a network).For example, the customer or user may be prompted to invoke applicationand use of the method 100 in FIG. 1, or request use of method 100 (e.g.,for a particular document, or for a particular device) before printing adocument or before using the device. In an embodiment, for a machinethat is configured to implement the method 100, the machine may have thedescribed ripped segmentation shown in method 100 in a default “OFF”state (e.g., due to potential performance degradation andconsiderations). When a customer or user wishes to process his/herdocument/image to enable correction and/or improvements to image qualityby applying substantially colorless material over text, the user mayimplement the method 100 by selecting (or switching) the setting of themachine. In another embodiment, the switch or selection to implement themethod 100 may be available to operator(s) or supervisor(s) for aparticular machine or server.

This feature as described by the method 100 can improve customersatisfaction with output documents. For example, it can improve changesto the electronic image in cases when text is inserted, or modified(e.g., as bit maps for reasons such as last minute corrections at bitmap level), or when secure or legal text is inserted into the document,and the like. Generally, because it segments the raster image todetermine any missing pixels that represent (black) text, the markedimage has increased accuracy and output quality. Accordingly, problemssuch as skip pitches and holes in output text are reduced.

In some cases, processing of each job using method 100 may require moreof the image data to be RIPped ahead before commitment to print,depending on the type of machine or device used for output. The numberof sheets that may needed to be RIP processed before commitment to printa particular document can be raised. The change (delta Δ) in sheets thatare raster image processing can be determined through testing, forexample.

FIG. 5 shows an example of a block diagram of a multifunction image path500 used to handle concurrent operations for an image processingapparatus. More specifically, image path 500 is representative of one ormore paths through which image data of an input document 502 or page,input into an image processing apparatus, may be processed using aplurality of processing elements (or modules) and then output. Anexample of such an apparatus may be a MFD, for example. The image pathof the image processing apparatus or device comprises, among otherdevices, an image input terminal (IIT) 504, a processor or processingelements 506 and 510, a memory 509 and/or a storage device 511, and animage output terminal (IOT) 512 and/or marking engine interface (alsoreferred to as a print engine). Generally, these elements (as will begenerally described) of the device are provided to perform functionsthat assist in receiving image data such as a scanned document,configuring the image path of the processing elements 506 and 510 toprocess the image data, and outputting the image data. The imageprocessing apparatus can comprise a plurality of image paths formanipulating image data of a document for output. One example includesprinting a document using a print driver 518 according to a selectedoutput mode of the image processing apparatus. However, it should benoted that the apparatus or device may comprise additional elements notdescribed herein or alternative elements for performing similarfunctions, and should not be limited to those elements as illustrated inFIG. 5. Generally, the image path shown corresponds to any number ofoutput modes that may be selected for an image processing apparatus.Further, with the herein disclosed method, existing image paths may beeasily altered. For example, modules for implementing segmentation mayalready exist in the image path, or a separate segmentation module maybe added to the image path for implementation after raster imageprocessing of an input document, if so desired. The illustratedmultifunction image path 500 for processing an electronic image is notlimiting.

The IIT 504 is used to scan or acquire an input document or page intoimage data to be processed along the multifunction image path 500. TheIIT 504 may be a digital scanner, for example. The scanner may captureimage data as binary or contone image data. Generally, however, anydevice used to scan or capture the image data of a document is regardedand will be referred to as an IIT. For example, the image data may becaptured by a scanner in a copier, a facsimile machine, a multi-functiondevice, a camera, a video camera, or any other known or later devicethat is capable of scanning a document and capturing electronic imagedata. In some embodiments, IIT 504 may be connected to a network ortelephone system, for example, to receive as input image data such asvia a facsimile (fax) machine or computer (CPU). Input documents and/orimage data may be received via a telephone number, an e-mail address, anInternet Protocol (IP) address, a server, or other methods for sendingand/or receiving electronic image data.

A processor or plurality of processing elements 506, 516 and 510 forprocessing and/or manipulating image data using a plurality ofoperations and/or processes are also provided in the image paths. Thedescription of the processing elements below provides an example ofdevices capable of implementing processes to be performed and should notbe limiting. For example, additional processing elements may be providedalong the image path 500. Alternatively, additional operations may beperformed on the image data other than or in addition to those describedwith reference to FIGS. 1-4.

The multifunction image path 500 may comprise a plurality of imageprocessing elements (or processors) and for manipulating image datareceived from the IIT 504 or other input devices using a plurality ofoperations and/or processes. The processing elements and may be acombination of image processing elements which comprise software andhardware elements that perform a number of operations on the image datareceived from the IIT 504 (or other source) using a set of parameters.The parameters are used to convert the images to the format desired asoutput (e.g., high quality) along the image path. The processingelements may be a part of a computer system or apparatus such as axerographic system, a photocopier, a printing device, or MFD. Forsimplicity purposes, the term “processing element” throughout theapplication will refer to one or more elements capable of executingmachine executable program instructions. It is to be understood that anynumber of processing elements may be used and that additional operationsor processes besides those described below may be provided in an imagepath.

More specifically, the multifunction image path 500 comprises a frontend processing element 506, a memory 509, storage 511, and a back endprocessing element 510. The front end processing element 506 is an imageprocessing element that receives image data from the IIT 504 and is usedto process the image data according to user preferences such that it maybe stored and later retrieved for output. The back end processingelement 510 is generally used at the end of an image path to retrievestored image data (e.g., from memory 509, storage 511, or system memory514) and to process the image data such that the image data may beoutput to a printing device as an accurate recreation of the originalinput or scanned image. Of course, processing elements may also be usedfor compression and/or decompression of image data.

Each of the image processing elements comprises an input and an output.Additionally, the system or apparatus may also include one or morecontrollers or routers (not shown) to select and route the image databetween the processing elements 506 and 510 and memory 509, storage 511,and/or storage 514, for example.

Front end processing element 406 receives as input the image data fromthe IIT 504 and processes the image data along the image path. Front endprocessing element 506 may be used to process the image data as well asdetermine user-defined operations generally known in the art. Forexample, the front end processing element 506 may be used for colorspace conversion, reduction or enlargement, document registration,and/or performing other operations or processes on the image data.

Memory 509 and/or storage 511 may be used to store image data. Forexample, memory 509 and/or storage 511 may be used to temporarily storethe original image data of document input via IIT 504. Converted (e.g.,contone to binary image data) or compressed image data may also bestored in the memory 509 and/or storage 511. Memory 509 and/or storage511 may be used to store machine readable instructions to be executed bythe processor/processing elements. The memory 509 and/or storage 511 maybe implemented using static or dynamic RAM (random access memory), afloppy disk and disk drive, a writable optical disk and disk drive, ahard disk and disk drive, flash memory, or the like, and may bedistributed among separate memory components. The memory 509 and/orstorage 511 can also include read only memory, or other removablestorage drive(s) or memory devices. Additional description regardingcomputer or machine readable instructions and medium is described belowwith respect to FIG. 6.

System memory 514 may also be considered a main memory of the imageprocessing apparatus. System memory 514 is used to run softwareassociated with a controller, for example. System memory 514 maycomprise, for example, a hard disk and drive which includes programs,image data, and the like that may be used for processing, etc. In someembodiments, system memory 514, memory 509, and/or storage 511 may beinterchangeable or provided as a single device.

Generally, also associated with memory 509 and storage 511 is a deviceor program that is capable of encoding and decoding image data. Forexample, the image data may be processing by a plurality ofcoder-decoder pairs, i.e., CODEC, which is generally known in the art.Codec may be provided to perform any number of compression/decompressiontechniques on the image data including, but not limited to JPEG orJBIG2. A compressor and decompressor may use compression/decompressionalgorithms or other encoding/decoding methods, and should not belimiting.

The front end processing element 506 may communicate with memory 509and/or storage 511 to store processed and/or compressed image data, forexample. Compressed image data may be stored in memory 509 and/orstorage 511 temporarily or for a later time when needed. When the imagedata is needed or it is time for marking (e.g., using the marking engineinterface/IOT 512 or printing device), the image data may be retrievedfrom memory 509, storage 511, and/or storage 514 via the back endprocessing element 510 to be exported, for example.

In some embodiments, the multifunction image path 500 may also include amiddle functions processing element 516 which may be used to performsome additional image data manipulation. Middle functions element 516may be used for middle function operations including, but not limitedto, rotation, annotation, and merging, and for compressing and/ordecompressing image data for output, for example. The middle functionsprocessing element 516 may communicate with memory and/or storage tostore processed and/or compressed image data, for example. The input andoutput of image data to the middle functions processing element 516depends on the selectively chosen image path or output mode. In someembodiments, middle functions processing element 516 may receive andstore image data in PDL format or intermediate image format (IIF). Themiddle functions element 516 may also process and format image data forexporting out on a network, such as PDF, TIFF, or JPEG file formats, orfor a fax device. Nonetheless, the functions performed by middlefunctions processing element 516 should not be limiting.

Back end processing element 510 receives processed image data retrievedfrom the memory 509 or storage 511. Back end processing element 510 maybe used to further render the image data for output. For example, backend processing element 510 may be used to convert the color space of theprocessed image data (e.g., convert from device independent color spacesuch as standard RGB (sRGB) or CIE L*a*b color space to device dependentCMYK color space), provide color balance, further rendering, filtering,and/or other operations or processes to prepare the images for marking.Subsequently, the back end processing element 510 may be used todecompress the image data and output the image data to the IOT 512. Theoutput of processed image data from the back end processing element 510depends on the image path or selected output mode.

In an embodiment, the processed image data may be directly output to themarking engine interface or IOT 512 for printing using a printer/MFD.The IOT 512 or marking engine interface may be associated with a printeror MFD which is used for printing documents. The IOT or marking engineinterface is used to output the processing image data to the printer fora copy or print job. The IOT 512 or marking engine interface may furtherperform image processing on the image data to make corrections orcompensate for deviation in the printing process. Alternatively, theback end processing element 510 may be used to perform further imageprocessing on the image data.

The IOT 512 outputs processed image data to the printer or apparatus tocomplete the scan image path, for example. Of course, the algorithms andprocesses used by the elements in the image path shown in FIG. 5 shouldnot be limiting. Any number of data compression algorithms (e.g.,lossless, lossy), decompression algorithms, color conversion algorithms(e.g., contone to binary, binary to grayscale, etc.) and the like may beperformed to provide a high quality output document 513 (in addition tothe method 100 of FIG. 1).

With regard to a print image path implementing the method 100 of FIG. 1,one possible print operation comprises a print driver 518 (also referredto as a print controller). Documents may be sent to print driver 518,for example, through a network interface and/or user interface (UI). Theprint controller 510 accepts content for digital images desired to beprinted in any one of a number of possible page description language(PDL) formats. The print driver 518 is used to manage print devices,e.g., color laser printers, production printers, and digital presses,especially in high-volume environments. The print controller 510 may bea part of the printing device itself or an external device, such as apersonal computer (PC) or server, or other digital device comprisingsoftware, that interfaces to a network and will accept image content andprocess the image content for copier or printer devices. In oneembodiment, the print driver 518 may be a digital front end (DFE).Printer driver 518 produces a PDL (Page Description Language) file 520for printing via an IOT 512. Printer controller 518 may interpret,convert or, in some cases rasterize input print data (if a raster imageprocessor is included therein) in the form of a page descriptionlanguage (e.g., PostScript, PCL), markup language (e.g., XML) or otherspecial document format or language into a formatted language orinstructions that IOT 512 can understand.

The PDL file is processed by a Raster Image Processing element (RIP) 522to produce formatted image data capable of being further processedbefore compression and marking. The RIP 522 may be located within anoutput device itself or externally implemented as hardware, software, ora combination. As an example, RIP 522 may be implemented in a softwareapplication or device driver. A RIP 522 may also reside within printerdriver 518, in an embodiment. Examples of raster image processingoperations may include image and graphics interpretation, rasterization,scaling, segmentation, color space transformation, image enhancement,color correction, halftoning, compression etc.

Typically a ripped image is used for rendering by a print engine or IOT512. However, in accordance with this disclosure, the ripped image isfurther processed to produce at least greater image quality of text inthe output document. Specifically, the pixels of ripped image data areprocessed using method 100 in FIG. 1 to classify and/or determine pixelsrepresenting text in the output document. After processing via method100, the electronic image data can be compressed for storage in thesystem memory 514, storage 511, and/or memory 509, before being outputfor marking to IOT 512.

Then, the input to the IOT 512 is a rasterized bitmap file that isgenerated by a combination of the raster image processed image data(which may include any related instructions) and results of thesubsequent segmentation performed on the image data (e.g., see FIG. 2).The IOT 512 may further perform image processing to make corrections orcompensation to correct for deviations in the printing process and/or todetermine locations for marking with substantially colorless markingmaterial (as per the method of FIG. 2).

Generally, any suitable printing apparatus may be employed to implementmethod 100 and to comprehensively identify text pixels and marksubstantially colorless marking material over the text pixels in adocument. The marking materials of this disclosure can be used in orapplied by an image processing apparatus configured to generate anink-based (e.g., solid ink) or toner-based image on a substrate. Forexample, the printing apparatus may be a machine that incorporates aplurality of marking material applicators, stations, or housings, suchthat color marking materials (e.g., cyan, magenta, yellow, and black, orCMYK) may be housed therein for application to the substrate. Moreover,the applicators, stations, or housing may include at least one supply ofsubstantially colorless marking material, as described below withreference to FIG. 6. Its housing may be in addition to or in replace ofone or more other marking material applicators.

The herein described embodiments may be used in inkjet device, such as,for example, a solid inkjet printer, an aqueous inkjet printer, or a UVinkjet printer, or they may be used in an electrophotographic printingsystem or a lithographic printing system.

For explanatory purposes only, FIG. 6 is a block diagram illustrating anexemplary printing apparatus 600 that may be used in accordance with anembodiment for outputting documents processed using the method 100 ofFIG. 1. The illustrated elements of apparatus 600 of FIG. 6 may be apart of a computer system, device, or apparatus such as a xerographicsystem, a photocopier, a printing device, or a multi-function device(MFD). In an embodiment, the apparatus 600 may be a phase change orsolid or UV-cured ink jet printing system, or electrophotographicprinting system.

For example, the apparatus 600 may comprise an image capture device 602,at least one processor 604, a controller(s) 606, memory 608 and/orstorage 610, marking devices 612, and an output device 614. Each of thedevices shown in system 600 may also be considered modules, and,therefore, the terms “device” and “module” are used interchangeablyherein. The devices or modules illustrated in FIG. 6 (further describedbelow) are not meant to be limiting. It is to be understood that anynumber of elements or modules may be used (e.g., more or less modulesmay be used and/or combined) and that additional operations or processesbesides those described below may be provided. FIG. 5 (described above)illustrates an exemplary image path for processing image data accordingto method 100 using such devices or modules, which may be included insystem 600.

Generally, some of devices or modules shown in FIG. 6 are known by thoseof skill in the art and are therefore not discussed in great detailherein. Moreover, FIGS. 5 and 6 show similar devices and it should beunderstood that the above description for the features in the image pathof FIG. 5 applies to the features in FIG. 6. The features in FIG. 6 aredesigned to show a system incorporating the basic elements used toprocess and mark the image data (e.g., through an image path 500 asshown in FIG. 5).

For example, the image capture device 602 is configured to provideand/or receive image data, much like the described input device or IIT504. At least one processor 604 or processing element is configured toprocess pixels of the image data in order to process image data foroutput. Controller 606 may be used to direct or control any number ofmodules or devices in system 600. The at least one processor 604 may beinstructed by one or more controllers 606 to process the image data thatis provided or received. The processor or processing element may be acombination of image processing elements or modules which comprisesoftware and hardware elements that may perform a number of operationson the image data received from the image capture device 602 using a setof parameters (e.g., processors 506, 516, and 510 of FIG. 5). Theparameters may be used to convert the images to the format desired asoutput (e.g., high quality) along an image path.

When images are called for marking, they may be called out of memory 608or storage 610 and subsequently processed and/or decompressed. Adecompressor 612 may be used to restore the compressed data using anyalgorithm for reversing the used compression algorithm, so that theimage data comprises the segmented and ripped image data andcomprehensive/clear tag plane information.

An output device 614 may be provided to optionally output the image data(e.g., as noted in the method 100 at 112) (upon cue). Output device 614may be any type of device that is designed to output the image data,e.g., IOT 512. In an embodiment, the output device 614 may decompressthe image data and information before output. In some embodiments,decompressor 612 is provided in output device 614 of system 600 todecompress image data before outputting the image data with outputdevice 614, if needed. The decompressor 612 and output device 614 may bethe same module, or separate modules.

The marking devices 616 and 618 are applicators, stations, print-heads,or housings incorporated into the output device 614 of the apparatus 600used to mark or apply marking materials. For example, marking devices616 can be used to mark color (CMYK) inks for printing image data of adocument and marking device 618 can be used to mark substantiallycolorless marking material over at least the indicated or identifiedtext pixels of a document. In an embodiment, controller 606 is used tocontrol one or more marking devices or applicators 616 and/or 618 ofsystem 600. Any number of marking applicators 616, 618 may be used.

With regards to the substantially colorless marking material, it shouldbe understood that application of the material onto the substrate andover indicated text pixels is not meant to limit visibility of themarked image/text pixels. Rather, as noted above, it is intended tomaintain integrity of the ink/toner that is applied to the substrate.Additionally, by applying substantially colorless marking material toidentified text locations (as opposed to an entire page, for example),less material is used and therefore this disclosure further reducescosts associated with printing.

The marking material used for application over the identified textpixels is substantially colorless. In an embodiment, the markingmaterial may be at least colorless to light having wavelengths withinthe visible spectrum. As used throughout this disclosure, asubstantially “colorless” marking material is defined as a material thatis substantially free of any colorants such as pigments or dyes, whichgive the other inks/toners their characteristic color properties in thevisible range. This is because the marking material is used as anovercoat and applied over printed pixels of image data on the substrate(e.g., overcoats on ink based images and xerographic images), to allowfor printed image data to still be viewed through the marking material.

The substantially colorless marking material may or may not be visibleto the naked human eye. The “naked human eye” refers to human visualperception that is unaided by a light-discerning or light-collectingoptical device. It is envisioned that in some instances, the markingmaterial could be used as a security mark for identification orauthentication purposes. The medium could also be configured, in someembodiments, to be substantially visible to a machine when the medium isilluminated by visible or non-visible light. The “machine” refers to adevice that is used to distinguish or discern a security mark. In anembodiment, a machine (e.g., a scanner) may include a light source. Inanother embodiment, a machine (e.g., a camera) may be aided by a lightsource (e.g., laser or radiation source). The machine can be a part of aprinting system, such as system 600, or a separate device. The mediummay be an “active” marking material, i.e., a marking material that isconfigured to substantially react to radiation having at least somewavelengths outside a visible spectrum, such that the mark isdistinguishable by the human eye or by a machine when exposed to suchradiation.

The gloss value of the marking material can be of any value (e.g., asmeasured by a gloss meter) and is not meant to be limiting. In anembodiment, the gloss of the marks over the printed image data issubstantially similar or the same as that of the substrate. In someembodiments, the marking material can have a gloss appearance that isdifferent from that of a default paper or substrate used in a printingapparatus. Also, the substrate on which the marking material is appliedmay comprise a matte or a glossy surface and is not meant to belimiting.

Referring back to FIG. 6, the processor 604, marking device(s) 616and/or 618, and/or other associated modules of the apparatus 600illustrated in FIG. 6 may be used to perform or implement thenon-limiting steps 102-114 as described in method 100 of FIG. 1, forexample. These steps may or may not include the implementationsillustrated in FIGS. 2, 3 and 4. The system 600 may also process imagedata using modules shown in the image path 500 of FIG. 5.

As briefly mentioned above, other embodiments include incorporating theabove methods into a set of computer executable instructions readable bya computer and stored on a data carrier or otherwise a computer readablemedium, such that the method 100 (in FIG. 1)—as well as method 200 and300—is automated. In a possible embodiment, the methods may beincorporated into an operative set of processor executable instructionsconfigured for execution by at least one processor. FIGS. 1-4 show flowcharts of such computer readable instructions that may be implemented byone or more processing elements/processors. The methods shown in theFigures may be implemented by new or existing systems, including thosethat may include existing determinations for applying substantiallycolorless marking material, but that can be subject to missingidentification of pixel locations, which can result in lower qualityoutput documents. For example, in some embodiments, memory 608 orstorage 610 is configured to store non-transitory computer executableinstructions such that when the executable instructions are executed bya computer or processor 604, and cause a computer or processor toautomatically perform a method (e.g., method 100) for processing imagedata for outputting documents. In embodiments of the present disclosure,the processor(s), for example, may be made in hardware, firmware,software, or various combinations thereof. The system 600 may be acomputer system which includes a bus or other communication mechanismfor communicating information, and one or more of its processingelements may be coupled with the bus for processing information. Also,the machine-readable instructions may be stored in various mechanismsfor storing and/or transmitting information in a form that may be readby a machine (e.g., a computing device). For example, a machine-readablestorage medium may comprise RAM or other dynamic storage devices (afloppy disk and disk drive, a writable optical disk and disk drive(CD-ROM), a hard disk and disk drive, flash memory, or the like), andmay be distributed among separate memory components. Storage device 610may include read only memory (ROM) or other static storage devicecoupled to the bus to store executable instructions for the processor orcomputer. Alternatively, another storage device, such as a magneticstorage disk or optical storage media, may also be coupled to the busfor storing information and instructions. Such devices are not meant tobe limiting. In an embodiment, a machine-readable transmission media mayinclude forms of propagated signals, including carrier waves, infraredsignals, digital signals, and other media for transmitting information.While firmware, software, routines, or instructions may be described inthe above disclosure in terms of specific exemplary aspects andembodiments performing certain actions, it will be apparent that suchdescriptions are merely for the sake of convenience and that suchactions in fact result from computing devices, processing devices,processors, controllers, or other devices or machines executing thefirmware, software, routines, or instructions.

In alternative embodiments, hard-wired circuitry may be used in place ofor in combination with software instructions to implement thedisclosure. Thus, embodiments of this disclosure are not limited to anyspecific combination of hardware circuitry and software. Any type ofcomputer program product or medium may be used for providinginstructions, storing data, message packets, or other machine readableinformation associated with the method 100, 200, and/or 300. Thecomputer readable medium, instructions, or product should not belimiting.

In addition, it should be noted that the system/apparatus 600 mayinclude a local display or control panel user interface (UI) that allowsa customer to read input, instructions, and features for processingimage data. The user interface may be used to alternatively set thesystem or to select to implement the method 100 of FIG. 1, previouslydescribed. The location and accessibility of the features on thedisplay/control panel interface should not be limiting. For example, auser may scroll through a list of processing features by accessing themdirectly on the machine or on a computer.

The methods described herein can be used with any number ofapplications, including, but not limited to, office environments. Forexample, the application of substantially colorless marking material totext portions of bills may be beneficial, so that the vulnerability foramounts or addresses to be scraped or rubbed off is substantiallyreduced and/or prevented. Any number of industries can utilize theherein disclosed methods.

While the principles of the disclosure have been made clear in theillustrative embodiments set forth above, it will be apparent to thoseskilled in the art that various modifications may be made to thestructure, arrangement, proportion, elements, materials, and componentsused in the practice of the disclosure.

While this disclosure has been described in connection with what ispresently considered to be the most practical and preferred embodiments,it is to be understood that it is capable of further modifications andis not to be limited to the disclosed embodiments, and this disclosureis intended to cover any variations, uses, equivalent arrangements oradaptations of the inventive concepts following, in general, theprinciples of the disclosed embodiments and including such departuresfrom the present disclosure as come within known or customary practicein the art to which the embodiments pertains, and as may be applied tothe essential features hereinbefore set forth and followed in the spiritand scope of the appended claims.

It will be appreciated that various of the above-disclosed and otherfeatures and functions, or alternatives thereof, may be desirablycombined into many other different systems/devices or applications.Various presently unforeseen or unanticipated alternatives,modifications, variations, or improvements therein may be subsequentlymade by those skilled in the art which are also intended to beencompassed by the following claims.

What is claimed is:
 1. A processor-implemented method for processingimage data in an image processing apparatus, the image processingapparatus comprising at least one processor for processing documentscontaining image data comprising a plurality of pixels, the methodcomprising the following acts implemented by the at least one processor:receiving a page description language file of image data comprising aplurality of pixels and related image instructions; raster imageprocessing the page description language file to create a bitmap filewith a first data structure indicating at least pixels representingtext; segmenting the bitmap file to determine at least pixels in thebitmap file representing text not indicated in the first data structureto form a second data structure, and combining the first data structureand the second data structure to form a third data structure indicatinglocations for marking substantially colorless marking material onto asubstrate using an image output device.
 2. The method according to claim1, wherein the first data structure is a binary tag plane indicatingpixels representing text as “ON”.
 3. The method according to claim 1,wherein the second data structure is a binary tag plane indicatingpixels representing text as “ON”.
 4. The method according to claim 1,wherein the third data structure is a comprehensive binary tag planeindicating locations for marking substantially colorless markingmaterial based on a combination of the indicated pixels representingtext from the first data structure and the second data structure, and,wherein the combining comprises, for each pixel of the image data, if atleast one of the first data structure or the second data structureindicates that a pixel represents text, then indicating in the thirddata structure that a location of the pixel is configured to be coveredwith substantially colorless marking material.
 5. The method accordingto claim 4, wherein the method further comprises marking pixels from thebitmap file onto the substrate using the image output device, andmarking the substantially colorless marking material on each of thelocations of the text pixels as indicated by the comprehensive binarytag plane using the image output device.
 6. The method according toclaim 1, wherein the method further comprises marking pixelsrepresenting text on the substrate using the image output device.
 7. Themethod according to claim 6, wherein the method further comprisesmarking substantially colorless marking material onto the substrate overthe pixels representing text based on the third data structure using theimage output device.
 8. The method according to claim 1, wherein thesegmenting comprises, for each pixel: determining if a pixel in thebitmap file is a text pixel, and wherein if the pixel is a text pixel,then indicating a location associated with that pixel as “ON” in thesecond data structure, else indicating the location as “OFF” in thesecond data structure.
 9. The method according to claim 1, wherein themethod further comprises sending the bitmap file and the third datastructure to the image output device.
 10. The method according to claim9, wherein the output device comprises marking devices for markingpixels with marking materials, and wherein the method further comprisesmarking pixels with marking materials onto the substrate using themarking devices based on at least the related image instructions andmarking the locations over pixels representing text with substantiallycolorless marking material based on the third data structure.
 11. Themethod according to claim 1, wherein the image processing apparatusfurther comprises an image output device configured to output imagedata, wherein the method further comprises sending the bitmap file tothe image output device, and wherein the combining to form the thirddata structure indicating locations for marking substantially colorlessmarking material onto the substrate is executed by the image outputdevice.
 12. The method according to claim 1, wherein the bitmap filecomprises information related to pixels of the image data for markingwith substantially colorless marking material, and wherein the methodfurther comprises combining the bitmap file and the third data structureto form a fourth data structure indicating locations for markingsubstantially colorless marking material onto a substrate using an imageoutput device.
 13. A system for processing image data having a pluralityof pixels comprising at least one processing element, the at least oneprocessing element comprising an input and an output and configured toreceive and process pixels of the image data, the at least oneprocessing element configured to: receive a page description languagefile of image data comprising a plurality of pixels and related imageinstructions; raster image process the page description language file tocreate a bitmap file with a first data structure indicating at leastpixels representing text; segment the bitmap file to determine at leastpixels in the bitmap file representing text not indicated in the firstdata structure to form a second data structure, and combine the firstdata structure and the second data structure to form a third datastructure indicating locations for marking substantially colorlessmarking material onto a substrate using an image output device.
 14. Thesystem according to claim 13, wherein the first data structure is abinary tag plane indicating pixels representing text as “ON”.
 15. Thesystem according to claim 13, wherein the second data structure is abinary tag plane indicating pixels representing text as “ON”.
 16. Thesystem according to claim 13, wherein the third data structure is acomprehensive binary tag plane indicating locations for markingsubstantially colorless marking material based on a combination of theindicated pixels representing text from the first data structure and thesecond data structure, and, wherein the combining by the at least oneprocessing element comprises, for each pixel of the image data, if atleast one of the first data structure or the second data structureindicates that a pixel represents text, then indicating in the thirddata structure that a location of the pixel is configured to be coveredwith substantially colorless marking material.
 17. The system accordingto claim 16, wherein the system comprises the image output device andwherein the image output device is configured to receive the bitmap fileand the third data structure, mark pixels from the bitmap file onto thesubstrate, and mark the substantially colorless marking material on eachof the locations of the text pixels as indicated by the comprehensivebinary tag plane.
 18. The method according to claim 13, wherein thesystem comprises the image output device and wherein the image outputdevice is configured to marking pixels representing text on thesubstrate.
 19. The method according to claim 18, wherein the imageoutput device is further configured to mark substantially colorlessmarking material onto the substrate over the pixels representing textbased on the third data structure.
 20. The system according to claim 13,wherein the segmenting by the at least one processing element comprises,for each pixel: determining if a pixel in the bitmap file is a textpixel, and wherein if the pixel is a text pixel, then indicating alocation associated with that pixel as “ON” in the second datastructure, else indicating the location as “OFF” in the second datastructure.
 21. The system according to claim 13, wherein the at leastone processing element is configured to send the segmented bitmap fileand the third data structure to the image output device.
 22. The systemaccording to claim 21, wherein the system comprises the image outputdevice, wherein the output device comprises marking devices for markingpixels with marking materials, and wherein the image output device isconfigured to mark pixels with marking materials onto the substrateusing the marking devices based on at least the related imageinstructions and mark the locations over pixels representing text withsubstantially colorless marking material based on the third datastructure.
 23. The system according to claim 13, wherein the systemfurther comprises an image output device configured to output imagedata, wherein the at least one processor is configured to send thebitmap file to the image output device, and wherein the image outputdevice is configured to form the third data structure indicatinglocations for marking substantially colorless marking material onto thesubstrate.
 24. The system according to claim 13, wherein the bitmap filecomprises information related to pixels of the image data for markingwith substantially colorless marking material, and wherein the system isfurther configured to combine the bitmap file and the third datastructure to form a fourth data structure indicating locations formarking substantially colorless marking material onto a substrate usingan image output device.
 25. A non-transitory computer readable mediumhaving stored computer executable instructions, wherein the computerexecutable instructions, when executed by a computer, direct a computerto perform a method for processing image data, the method comprising:receiving a page description language file of image data comprising aplurality of pixels and related image instructions; raster imageprocessing the page description language file to create a bitmap filewith a first data structure indicating at least pixels representingtext; segmenting the bitmap file to determine at least pixels in thebitmap file representing text not indicated in the first data structureto form a second data structure, and combining the first data structureand the second data structure to form a third data structure indicatinglocations for marking substantially colorless marking material onto asubstrate using an image output device.
 26. The medium according toclaim 25, wherein the first data structure is a binary tag planeindicating pixels representing text as “ON”.
 27. The medium according toclaim 25, wherein the second data structure is a binary tag planeindicating pixels representing text as “ON”.
 28. The medium according toclaim 25, wherein the third data structure is a comprehensive binary tagplane indicating locations for marking substantially colorless markingmaterial based on a combination of the indicated pixels representingtext from the first data structure and the second data structure, and,wherein the combining comprises, for each pixel of the image data, if atleast one of the first data structure or the second data structureindicates that a pixel represents text, then indicating in the thirddata structure that a location of the pixel is configured to be coveredwith substantially colorless marking material.
 29. The medium accordingto claim 25, wherein the segmenting comprises, for each pixel:determining if a pixel in the bitmap file is a text pixel, and whereinif the pixel is a text pixel, then indicating a location associated withthat pixel as “ON” in the second data structure, else indicating thelocation as “OFF” in the second data structure.
 30. The medium accordingto claim 25, wherein the method further comprises sending the bitmapfile and the third data structure to the image output device.
 31. Themedium according to claim 25, wherein the method further comprisesmarking pixels with marking materials onto the substrate using markingdevices of an output device based on at least the related imageinstructions and marking the locations over pixels representing textwith substantially colorless marking material based on the third datastructure.
 32. The medium according to claim 25, wherein the bitmap filecomprises information related to pixels of the image data for markingwith substantially colorless marking material, and wherein the methodfurther comprises combining the bitmap file and the third data structureto form a fourth data structure indicating locations for markingsubstantially colorless marking material onto a substrate using an imageoutput device.